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(54) Method for reducing processing power requirements of a video decoder 



(57) The invention described herein permits video 
decoders of varying degrees of computational power to 
decode bitstreams with varying degrees of visual quality 
degradation. It does so by reducing processing power 
requirements of a video decoder based on both bit- 
stream contents and decoder capabilities. One method 
it uses is the reduction of motion compensation 
processing by modifying the use or_ values of motion 
vectors, such as by turning some motion compensation 



off, or by limiting the precision of motion vectors during 
decoding. Another method is by limiting the coefficient 
processing so as to reduce the computational require- 
ments. Another method is to limit the processing of color 
components, and another method is by reducing the 
amount of filtering performed on the decoder's output 
video pictures. 
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Description 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 5 

[0001] The present invention relates to a method for 
reducing processing power requirements of a video 
decoder, and more particularly, to a digital video decod- 
ers and the reduction of computational requirements of 10 
these decoders. 

2. Description of the Related Art 

[0002] Digital video has become widespread in the 75 
field of consumer electronics, due in large part to the 
emergence of digital video standards such as MPEG1 
(see "CD1 1 172 - Coding of Moving Pictures and Asso- 
ciated Audio for Digital Storage Media at up to about 1 .5 
Mbps" by International Organisation for Standardisa- 20 
tion, ISO MPEG Document, ISO-IEC/JTC1/SC2/WG11, 
1994), MPEG2 (see "IS13818 - Generic coding of Mov- 
ing Pictures and Associated Audio" by International 
Organisation for Standardisation, ISO MPEG Docu- 
ment. ISO-IEC/JTC1/SC2/WG11. 1994), and the 25 
emerging standard MPEG4, which includes further 
added functionality and quality over MPEG1 and 
MPEG2. In MPEG1 and MPEG2 decoders, there are 
certain expectations regarding the decoder computa- 
tional power which must be met in order to conform to 30 
the respective standard. For example, in the MPEG2 
standard, Main Profile and Main Level (MP@ML) 
describes a set of bounds on the bitstream and associ- 
ated video which ail conformant MP@ML decoders 
must adhere to. 35 
[0003] There are many situations where a decoder 
lacks sufficient computational power to decode a bit- 
stream as it was intended. One example is on the inter- 
net where typically MPEG1 video bitstreams can be 
found and decoded using computers varying from high 40 
end scientific work stations to simple personal comput- 
ers. When computational power is limited, one way the 
decoder can reduce it's computational requirements is 
to simply slow down the decoder output picture rate 
enough to permit all decoding to be accomplished. This 45 
was a very common method used by software based 
MPEG1 video decoders running on personal comput- 
ers. Another method is to periodically skip the decoding 
of some pictures. For example, bi-directionally predicted 
pictures (B-pictures) can be skipped, effectively reduc- so 
ing the decoder output picture rate by picture-dropping. 
MPEG4 includes the concept of video objects, which 
are picture sequences which may be used to describe a 
separable object in a scene. If a scene contains many 
objects, the least important objects can be dropped in 55 
favor of giving the necessary computational power to 
the decoding of the more important objects. 
[0004] There is a growing abundance of digital video 



bitstreams available, and a growing number of computa- 
tional requirements associated with each. Due to the 
wide range of platforms that can be used for video 
decoding, there is a need for decoders which can 
decode bitstreams without requiring the full computa- 
tional power required to meet conformance criteria. 
Existing techniques such as picture display rate reduc- 
tion, picture dropping or object dropping techniques 
reduce the computational power at the expense of 
decoded video picture quality and synchronisation. For 
example, changing the picture display rate and picture 
dropping can have an effect on the perceived synchro- 
nisation of audio and video, commonly referred to as lip- 
synch. It also has the effect of making scenes with 
motion appear jerky. 

[0005] An object of this invention is to permit video 
decoders to reduce the computational requirements of 
decoding a bitstream without affecting the picture rate. 
This will permit lip-synch to be maintained while com- 
promising visual quality. It will also permit scenes which 
become jerky using picture dropping techniques to 
appear more smooth. Similarly, it will permit more 
objects to be present in the scene, since the computa- 
tional power can be allocated to more objects, at the 
expense of object quality. 

SUMMARY OF THE INVENTION 

[0006] An object of this invention is to permit video 
decoders which lack the computational power to 
decode a bitstream to conformance, to decode a bit- 
stream with varying degrees of visual quality degrada- 
tion. This will permit a wide variety of decoders to be 
made, each with varying cost/performance trade-offs. 
An expensive decoder with a very high computational 
power can be used to decode bitstreams with a much 
better resulting quality than an inexpensive decoder 
with low computational power. By using this invention, 
the same bitstream may be decoded by a wide range of 
computational power decoders, to result in varying 
degrees of acceptable visual quality. 
[0007] An object of this invention is to reduce the cost 
of video decoders. By designing video decoders that 
are able to meet constraints such as those imposed by 
MPEG2 MP@ML limitations, excessive computational 
power overhead must be built into the decoder to guar- 
antee real time picture decoding of worst-case (high 
complexity) bitstreams. In other words, the pictures are 
decoded on time even when the worst case bitstream is 
decoded. However, by using this invention, decoders 
can be made which gracefully degrade picture quality 
when their performance limitations are met 
[0008] For the purpose of solving the above described 
problems, the method of reducing processing power 
requirements of a video decoder described herein was 
invented. Said processing power requirements may be 
controlled based on a throttling amount. Said throttling 
amount may be based on one or more measures of the 
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' processing power required to decode one or more bit- 
streams, one or more measures of said decoder's 
processing capabilities, or some combination of these 
measures. 

[0009] The measures of the processing power 5 
required to decode a bitstream may comprise of an indi- 
cation of the syntax elements in said bitstream, an indi- 
cation of the type of processing required for said 
bitstream, an indication of the amount of processing 
required for said bitstream, or some combination of 10 
these indications. 

[001 0] Reduction of processing power requirements is 
accomplished by reducing the processing power used 
for one or more decoder functions by limiting said 
decoder function in some way. is 
[001 1] The limiting may comprise turning off the use 
of one or more of the motion vectors normally used to 
retrieve a motion compensated reference. This may be 
done by selecting from a choice of motion vectors which 
normally are used to retrieve a pixel regions motion 20 
compensated reference predictor region, one or more 
motion vectors whose use is turned off. 
[001 2] Selection of said motion vectors may comprise 
of selecting the motion vectors which are of temporally 
longest distance, selecting the motion vectors which are 25 
least highly correlated with those motion vectors in sur- 
rounding regions of the picture region being decoded, 
selecting the motion vectors which are of spatially long- 
est distance, selecting all motion vectors, or any combi- 
nation of these and other selection criteria. 30 
[001 3] Another method for limiting said decoder func- 
tion comprises of modifying motion vectors, possibly by 
limiting the precision and/or range of one or more of the 
decoder's motion vectors. 

[0014] Another method for limiting said decoder func- 35 
tion comprises of reducing the number of coefficients 
inverse quantized and inverse DCT transformed by 
selectively setting coefficients to alternate values, such 
as zero. 

[001 5] Another method for limiting said decoder func- 40 
tion comprises of reducing the amount of decoder 
processing used for decoding the color components of 
the video bitstream. 

[001 6] Another method for limiting said decoder func- 
tion comprises of reducing the amount of processing 45 
performed on the decoder's output video pictures. 
[0017] The throttling amount serves to control which 
and by how much to limit said decoder functions in 
some way. It is possible to determine the processing 
power requirements from one or more bitstreams, as so 
well as the existing processing power capabilities of the 
decoder, and use this information to make a decision 
about which and how much to throttle, or limit said 
decoder functions during the decoding of said bit- 
streams By limiting the decoder functionality, the 55 
processing power can be reduced. 
[001 8] The identification of which functions to limit and 
in what way can be made using indications such as the 
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syntax elements in said bitstream, and the type and 
amount of processing required for said bitstream. Said 
limiting may comprise turning off the use of one or more 
of the motion vectors normally used to retrieve a motion 
compensated reference, based on a decision made with 
reference to indications in the bitstream about what 
motion vectors exist, or some other indications from the 
bitstream or decoder. 

[0019] The choice of what motion vectors in a picture 
to turn off can be further refined by selecting the motion 
vectors which are of temporally longest distance, select- 
ing the motion vectors which are least highly correlated 
with those motion vectors in surrounding regions of the 
picture region being decoded, selecting the motion vec- 
tors which are of spatially longest distance, selecting all 
motion vectors, or any combination of these and other 
selection criteria. 

[0020] Similarily, said limiting may comprise of limiting 
the precision and/or range or some other modification of 
one or more of the decoder's motion vectors. 
[0021 ] Another method for limiting said decoder func- 
tion comprises of reducing the number of coefficients 
inverse quantized and inverse DCT transformed by 
selectively setting coefficients to alternate values which 
are easy to inverse quantize and inverse DCT, such as 
zero. The decision to limit these decoder functions may 
be based on information regarding said bitstream 
and/or said decoder. 

[0022] Another method for limiting said decoder func- 
tion comprises of eliminating some or all of the process- 
ing required during color component decoding. 
[0023] Another method for limiting said decoder func- 
tion comprises of limiting the processing applied to the 
decoded video pictures. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0024] 

Fig. 1 is a block diagram of a first embodiment of 
the Invention. 

Fig. 2 is a block diagram of a second embodiment 
of the Invention. 

Fig. 3 is a flow chart using motion vector throttling. 
Fig. 4 is a flow chart using picture size and rate. 
Fig. 5 is a diagram showing !/£ pixel motion com- 
pensation. 

Fig. 6 is a diagram showing modifying coefficient 
values 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

[0025] A first embodiment of the invention is shown in 
Fig. 1. One or more bitstreams are input via the bit- 
stream input 100, 101 . The video decoder 1 10 decodes 
the bitstream and outputs decoded video 120, 121. 
Measures of the bitstreams' processing requirements 
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130 and decoder's processing capabilities 131 are 
passed from the video decoder 110 to the decoder 
throttler 140. Throttling amount 132 is passed from the 
decoder throttler 1 40 to the video decoder 1 1 0. 

[0026] The operation of the embodiment in Fig. 1 is 5 
now described. The video decoder 1 10 extracts meas- 
ures of the bitstream processing requirements from the 
input bitstreams 101 and passes these measures 1 30 to 
the decoder throttler 140. The video decoder 110 also 
determines it's capabilities for decoding the bitstream it 
and passes this measure 131 to the decoder throttler 
140. The decoder throttler 140 uses these measures 
130, 131 to decide how the video decoder 1 10 function 
can be throttled and passes this throttling amount 132 
information to the video decoder 110. is 
[0027] It is possible that no measures of the bit- 
streams 1 30 are taken and passed to the decoder throt- 
tler 140. In this case, the decoder throttler 140 
determines how to throttle the video decoder 110 by 
using the measure of the decoder's processing capabil- 20 
ities 131 , or some other measure. It is also possible that 
no measures of the decoder's processing capabilities 

131 are taken and passed to the decoder throttler 140. 
In this case, the decoder throttler 140 determines how 

to throttle the video decoder 1 1 0 by using the measures 25 
of the bitstream processing requirements 130, or some 
other measure. 

[0028] It is possible that no measures of the bit- 
streams 130 or decoder's processing capabilities are 
taken and passed to the decoder throttler 140. In this 30 
case, the decoder throttler 1 40 determines how to throt- 
tle the video decoder 110 by using some other meas- 
ure, or by using some predetermined method. For 
example, it is possible that due to some information 
known about the decoderl 1 0 and decoder throttler 1 40 35 
when their architectures are designed, the decoder 
throttler 140 can always throttle in the same way. The 
number of measures and origin of the measures is not 
limited by this invention. 

[0029] The effect of the embodiment described by Fig. 40 
1 is the ability of the video decoder to throttle it's per- 
formance requirements. 

[0030] A second embodiment of the invention is 
shown in Fig. 2. One or more bitstreams are input via 
the bitstream input 200, 201. The video decoder 210 45 
decodes the bitstream and outputs decoded video 220, 
221. The input bitstreams 202 are passed to the bit- 
stream indicator extractor 250 where measurements 
are made concerning the bitstream. Indications such as 
syntax elements 251, type of processing required for so 
decoding 252, and the amount of processing required 
253, are passed to the decoder throttler 240. The 
decoder's processing capabilities 231 are passed from 
the video decoder 210 to the decoder throttler 240. 
Throttling amount 232 is passed from the decoder throt- 55 
tier 240 to the video decoder 21 0. 
[0031] The operation of the embodiment of Fig. 2 is 
now described. The bitstream indicator extractor 250 
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extracts measures of the bitstream processing require- 
ments from the input bitstreams 202. It determines indi- 
cators which characterise the stream's contents and 
types and amounts of processing required to decode 
the bitstreams and passes these indicators 251, 252, 
253 respectively to the decoder throttler 240. The video 
decoder 210 also determines it's capabilities for decod- 
ing the bitstream and passes this measure 231 to the 
decoder throttler 240. The decoder throttler 240 uses 
these indicators 230, 231 to decide how the video 
decoder 210 function can be throttled and passes this 
throttling amount 232 information to the video decoder 
210. 

[0032] It is possible that some or all of the indications 
251 , 252, 253 taken by the bitstream indicator extractor 
250 are not used by the decoder throttler 240. In this 
case, the decoder throttler 240 determines how to throt- 
tle the video decoder 210 by using the measure of the 
decoder's processing capabilities 231, or some other 
measure. It is also possible that no measures of the 
decoder's processing capabilities 231 are taken and 
passed to the decoder throttler 240. In this case, the 
decoder throttler 240 determines how to throttle the 
video decoder 210 by using the indications 251. 252, 
253 determined by the bitstream indicator extractor 250, 
or some other measure. It is possible that no bitstream 
indications 251 , 252, 253 or decoder's processing capa- 
bilities 231 are taken and passed to the decoder throt- 
tler 240. In this case, the decoder throttler 240 
determines how to throttle the video decoder 210 by 
using some other information, or by using some prede- 
termined method. For example, it is possible that due to 
some information known about the decoder 210 and 
decoder throttler 240 when their architectures are 
designed, the decoder throttler 240 can always throttle 
in the same way. The number of indicators and meas- 
ures and the origin of the indicators and measures are 
not limited by this invention. 

[0033] Fig. 2 and Fig. 3 can be used to describe 
another embodiment of this invention. In this embodi- 
ment, an MPEG2 video decoder is used. The following 
are extracted by the bitstream indicator extractor 250: 

picture_codingLjype (I, P f B,D) 
temporaLreference 

[0034] Fig. 3 describes a flow chart used to determine 
which motion vectors (forward or backward) in a B-pic- 
ture are to be discarded. The temporaLreference infor- 
mation is used to determine whether the forward or 
backward reference is of further temporal distance from 
the picture being decoded. The reference of furthest 
distance is not used, effectively turning off motion vec- 
tors referring to it. In other words, the B-picture only 
uses uni-directional prediction in this embodiment. 
[0035] In Fig. 3, |TR - TR for | is the absolute value of 
the difference in time of the picture being decoded and 
the picture used as the motion compensated forward 
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reference, and |TR - TR^^I is the absolute value of the 
difference in time of the picture being decoded and the 
picture used as the motion compensated backward ref- 
erence. 

[0036] The picture_coding_type and s 

temporal_reference are not the only bitstream charac- 
teristics which can be extracted and used for throttling 
the video decoder 210. This invention does not limit the 
type or number of indicators used for determining the 
way to throttle the video decoder 210. The invention 10 
does not limit the characteristics to specific syntax ele- 
ments. For example, the characteristics could be indica- 
tors that are not specific syntactic elements, like 
indicators of the number of macroblocks of a particular 
type. 15 
[0037] The indicators may have been inserted into the 
bitstream by the encoder, or may be implied by some 
bitstream elements. The indicators may be at a higher 
syntactic level, for example, the system bitstream level. 
The indicators taken from the bitstream for a particular 20 
element may not be used to control the decoding of that 
particular element. For example, the indicators associ- 
ated with one picture may be used to control the decod- 
ing of another picture. For example, the indicators of a 
preceding picture could be used to control the decoding 25 
of the current picture. 

[0038] The invention is also not limited to the fre- 
quency of video decoder 210 throttling as described by 
the embodiment described in Fig. 3. For example, the 
decision of whether to use bi-directional prediction may 30 
be made on a pixel region by region case. For example, 
the decision could be re-evaluated every macroblock. 
[0039] Also, the previous embodiment did not 
describe the use of measures of the decoder process- 
ing capability 231 . These can be used to detect when a 35 
decoder is very busy, at which time it cannot achieve 
real time decoding of the bitstreams, and so decoder 
throttling is needed. Likewise, the measures of decoder 
processing capability 231 can indicate when the 
decoder is not busy, and can achieve real time, video 40 
decoding with no throttling of it's functions. In other 
words, the method of making the decision of whether or 
not to turn off some motion vectors and their associated 
reference compensation processing, is not limited by 
this invention. 45 
[0040] The effect of this embodiment is the significant 
reduction of frame memory accessing and processing 
for B-pictures. Reference frame memory reading is 
effectively cut in half due to the absence of the bi-direc- 
tional processing of motion compensated references, so 
Although the quality of the resulting decoded video is 
degraded, this is considered an acceptable side-effect 
of the invention, since the invention is used to reduce 
decoder cost by degrading the picture quality. Since B- 
pictures are not used for further predictions, the errors 55 
in the pictures introduced by the throttling do not propa- 
gate to other pictures. 

[0041 ] Fig . 4 shows a further embodiment in which the 



picture size and rate is used as an indication of the 
amount of processing 253 which is required by a bit- 
stream. In this embodiment, the following additional ele- 
ments are determined from a bitstream: 

horizontal__size 

verticaLsize 

frame_rate_value 

[0042] These are then used to decide if the decoder 
will employ some throttling techniques or not, based on 
the bitstreams required decoder output pixel rate In the 
example shown, it is used, but is not limited to, enable 
the motion vector throttling described by Fig. 3. 
[0043] Another embodiment of the invented method 
modifies the motion vectors in a way that reduces the 
computational and/or memory bandwidth requirements 
of the decoder. One embodiment utilises the precision 
of motion vectors. 

[0044] Fig. 5 describes how pixel motion compen- 
sated references are determined by using the neigh- 
bouring full pixel values. If a spatial region required 1 /£ 
pixel interpolations, more reference frame memory pixel 
data is needed. For example, if an 8x8 pixel region is 
desired using full pixel motion vectors, an 8x8 region 
would be required to be read. On the other hand, if both 
horizontal and vertical 1 /4 pixel motion compensation 
was required, a 9x9 region must be read. After Vfe pixel 
interpolations of nearest neighbour full pixel values, the 
desired 8x8 region would be determined. Thus, it is pos- 
sible to reduce a video decoder's processing require- 
ments by limiting the precision of it's motion vectors to 
full pixel precision. 

[0045] The invention does not limit the reducing of the 
precision of the motion vectors from Vfc pixel to full pixel 
values. In fact, many video decoders do not access the 
reference frame memories pixel by pixel, but instead 
group the pixels into accessible words. Thus, limiting 
motion vector precision to the word size of the reference 
frame memories can be performed. 
[0046] The effect of this embodiment is the reduction 
of frame memory accessing and processing for pictures 
using motion compensated prediction. Although the 
quality of the resulting decoded video is degraded, this 
is considered an acceptable side-effect of the invention, 
since the invention is used to reduce decoder cost by 
degrading the picture quality. 

[0047] Another embodiment of the invented method 
reduces the motion vector range. For example, if the 
range of motion vectors is +/- 64 pixels, the range can 
be limited to +/- 16 in the decoder. The limited range is 
not specific to this embodiment. For example, it could be 
limited to 0 pixels. The effect of this embodiment is that 
the frame memory accessing is restricted to a smaller 
region of the picture. This can be particularly useful in 
motion compensation architectures which use memory 
cache. The more pixels which are accessed from cache, 
the fewer cache hits. Cache hits mean that the desired 
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pixel is not in the cache memory, so they must be 
fetched from a typically bigger and slower memory 
which holds the desired pixels. The overall effect of a 
cache hit is a reduced processing performance. The 
effect of reducing the motion vector range is to reduce 5 
the number of cache hits, and thus improve processing 
performance. 

[0048] Another embodiment of the invented method 
modifies the values of some of the coefficients decoded 
from the bitstream in order to make the downstream 10 
processing of these coefficients less computationally 
intensive. An example of such a modification is shown in 
Fig. 6. The original coefficients from the bitstream 600 
are modified to result in the modified values 601 . In this 
example, all values outside of the grey area 602 are set 75 
to zero. The effect of this in a DCT based system such 
as MPEG2 for example, where a video decoder typically 
performs inverse quantization before inverse DCT, is 
that by setting the coefficient values decoded from the 
bitstream to values easily inverse quantized, the 20 
processing requirements for inverse quantization can 
be reduced. For example, if some of the coefficients are 
set to zero, the result after inverse quantization of these 
coefficients can be set to zero without the usual calcula- 
tions as defined by the MPEG2 standard. 25 
[0049] In addition, some implementations of an 
inverse DCT utilize detected coefficients that are zero to 
reduce the computational requirements of the inverse 
DCT. For example, in a separable inverse DCT in which 
a subset of the coefficients are to be transformed, if the 30 
subset is all zero, the results will also be all zero. In this 
case the inverse transform can be completed much eas- 
ier simply by setting the results to zero rather than by 
calculating the inverse transform. This invention is not 
limited to setting coefficient values from the bitstream to 35 
zero. They can be modified to any value which results in 
less downstream processing. 

[0050] It is also does not limit which values are modi- 
fied. For example, it is possible to limit the number of 
non-zero coefficients in a block simply by stopping the 40 
saving of the values from the bitstream once the limit for 
the block is reached. 

[0051] This invention is not limited to decoders using 
the inverse DCT as it's transform. Other transform's 
coefficients can also be modified to reduce their compu- 45 
tational requirements. 

[0052] Another embodiment of this invention is the 
reduction or elimination of the processing of one or both 
of the color components. For example, the coefficient 
values can be discarded and the pixel values for the so 
color components set to neutral. In this case, there is no 
further processing of the color components required by 
the decoder. For example, inverse quantization, inverse 
DCT and motion compensation are not required for the 
color components. The effect of this embodiment is the 55 
significant reduction of decoder processing require- 
ments. Another effect is the loss of color in the displayed 
picture, but this may be an acceptable degradation due 



to the reduced decoder computations. 
[0053] Another embodiment of this invention is the 
reduction of processing performed on the decoded 
video pictures. For example, post filters can be used by 
a video decoder to remove some blocky noise intro- 
duced by the encoding and decoding processes. The 
effect of reducing this filtering is the reduction of the 
computational requirements of the post filter. The reduc- 
tion of the processing can be the reduction of the 
number of taps used by the post filter. Other forms of 
post processing can also be reduced, such as format 
conversion filters. 

[0054] There are many combinations of the invented 
methods which can be used to reduce the processing 
power requirements of a video decoder. This invention 
does not limit the combinations. For example, motion 
vectors can be modified, the coefficients extracted from 
the bitstream can by modified, and the processing per- 
formed on the decoded pictures limited within the same 
decoder. The overall effect of this invention is the great 
freedom of control over the processing requirements 
and output picture quality of a video decoder. This con- 
trol is useful when decoding single bitstreams or multi- 
ple bitstreams that may have associated priorities. 
[0055] One effect of this invention is that the process- 
ing power of video decoders can be reduced, permitting 
bitstreams with high computational requirements to be 
decoded by decoders with lower computational ability. 
By basing the decision of the type and amount of 
decoder function limiting on measures of the processing 
power required to decode bitstreams, measures of said 
decoder's processing capabilities, or some combination 
of these measures, an appropriate choice of limiting can 
be made which balances the trade-off between compu- 
tational requirements and picture quality. 
[0056] An effect of using indications of the syntax ele- 
ments in a bitstream and types and amounts of process- 
ing in said bitstream is that the type and amount of 
decoder function limiting can be made considering the 
content of the bitstream, thus permitting a more suitable 
and visually appealing choice for function limiting. 
[0057] An effect of using measures of the decoder's 
processing capabilities is that it permits the selection of 
functions to limit to be based on the decoder's abilities, 
which is dependant on the decoder's architecture. 
[0058] An effect of reducing the computational power 
of one or more functions in a decoder is the reduction of 
the decoder's computational power. 
[0059] An effect of turning off the use of one or more 
of the motion vectors normally used to retrieve a motion 
compensated reference is a reduction in processing 
requirements and reference frame memory access 
bandwidth. 

[0060] An effect of selectively turning off the use of 
one or more motion vectors is that it is possible to select 
those motion vectors to turn off which have a less detri- 
mental affect on picture quality than others, thus permit- 
ting a trade-off between picture quality and 
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computational requirements. 

[0061 ] An effect of limiting some of the motion vectors 
which are of temporally longest distance is that the vis- 
ual quality is typically less affected by turning off some 
of these than it is for motion vectors of shorter temporal 
distance. 

[0062] An effect of limiting the motion vectors which 
are least highly correlated with those motion vectors in 
surrounding regions of the picture region being decoded 
is that the perceptibility of degrading the picture quality 
of the regions with these motion vectors may be less 
than that of degrading more highly correlated motion 
regions. It also has the effect of permitting cache based 
architectures for motion compensation functions to have 
fewer cache hits if the less highly correlated motion vec- 
tors are not used. 

[0063] An effect of selecting the motion vectors which 
are of spatially longest distance is that it may permit 
cache based architectures to have fewer cache hits if 
the motion references are more close together, since 
presumably the reference data would not be going out- 
side of the cache so often. 

[0064] An effect of modifying the motion vectors or lim- 
iting the precision and/or range of one or more of the 
decoder's motion vectors is that the number of memory 
accesses can be reduced when accessing motion com- 
pensated references. 

[0065] An effect of reducing the number of coefficients 
inverse quantized and inverse DCT transformed by 
selectively setting coefficients to alternate values, such 
as zero, is that the computational requirements of 
inverse quantization and inverse DCT can be reduced. 
[0066] An effect of reducing the processing of the 
color components is the overall reduction of decoder 
processing. 

Claims 



1. A method of reducing processing power require- 
ments of a video decoder comprising: 

controlling said processing power require- 
ments of said decoder by using a predeter- 
mined throttling amount. 

2. A method according to claim 1 , wherein determina- 
tion of said predetermined throttling amount com- 
prises the use of one or more of the following: 

one or more measures of the processing power 
required to decode one or more bitstreams; 
one or more measures of said decoder's 
processing capabilities. 

3. A method according to claim 2, wherein said meas- 
ures of the processing power required to decode a 
bitstream comprises of one or more of the following: 



10 4. 
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an indication of the syntax elements in said bit- 
stream; 

an indication of the t /pe of processing required 
for said bitstream: 

an indication of the amount of processing 
required for said bitstream; 
a combination of the type and amount of 
processing required for said bitstream. 

A method according to claim 1 , 2 or 3, wherein said 
controlling said processing requirements com- 
prises: 

reducing the processing power used for one or 
more decoder functions by limiting said 
decoder function in some way. 

A method according to claim 4, wherein said limit- 
ing said decoder function comprises: 

turning off the use of one or more of the motion 
vectors normally used to retrieve a motion 
compensated reference. 

A method according to claim 4, wherein said limit- 
ing said decoder function comprises the steps: 

selecting from a choice of motion vectors which 
refer to different reference pictures, one or 
more motion vectors to turn off; and 
turning off the use of selected motion vectors 
normally used to retrieve a motion compen- 
sated reference. 

A method according to claim 6, wherein said select- 
ing motion vectors comprises of one or more of the 
following: 

selecting the motion vectors which are of tem- 
porally longest distance; 
selecting the motion vectors which are least 
highly correlated with those motion vectors in 
surrounding regions of the picture region being 
decoded; 

selecting the motion vectors which are of spa- 
tially longest distance; and 
selecting all motion vectors. 

A method according to claim 4, wherein said limit- 
ing said decoder function comprises: 

modifying the value of one or more of the 
decoder's motion vectors. 



55 9. A method according to claim 8, wherein said modi- 
fying the value comprises: 

limiting the precision of one or more of the 
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decoder's motion vectors. 

10. A method according to claim 8, wherein said modi- 
fying the value comprises: 

5 

limiting the range of one or more of the 
decoder's motion vectors. 

11. A method according to claim 4, wherein said limit- 
ing said decoder function comprises: 10 

reducing the number of coefficients inverse 
quantized and jnverse DCT transformed by 
selectively setting coefficients to alternate val- 
ues. 15 

12. A method according to claim 1 1 , wherein said alter- 
nate values comprises: zero. 

1 3. A method according to claim 4, wherein said limit- so 
ing said decoder function comprises: 

eliminating the decoder processing of one or 
more of the color components. 

25 

14. A method according to claim 4, wherein said limit- 
ing said decoder function comprises: 

reducing the amount of processing performed 
on decoded pictures preceding their display. 30 
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(54) Method for reducing processing power requirements of a video decoder 



(57) The invention described herein permits video 
decoders of varying degrees of computational power to 
decode bitstreams with varying degrees of visual quality 
degradation. It does so by reducing processing power 
requirements of a video decoder based on both bit- 
stream contents and decoder capabilities. One method 
it uses is the reduction of motion compensation process- 



ing by modifying the use or values of motion vectors, 
such as by turning some motion compensation off, or by 
limiting the precision of motion vectors during decoding. 
Another method is by limiting the coefficient processing 
so as to reduce the computational requirements. Anoth- 
er method is to limit the processing of color components, 
and another method is by reducing the amount of filter- 
ing performed on the decoder's output video pictures. 
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